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Abstract. We consider a controlled diffusion process {Xt)t>o where the con- 
troller is allowed to choose the drift fit and the volatility at from a set K,{x) C 
R X (0, oo) when Xt = x. By choosing the largest ^ at every point in time an 
extremal process is constructed which is under suitable time changes stochas- 
tically larger than any other admissible process. This observation immediately 
leads to a very simple solution of problems where ruin or hitting probabilities 
have to be minimized. Under further conditions this extremal process also 
minimizes "drawdown" probabilities. 
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1. Introduction 

Consider a one-dimensional controlled diffusion process {Xt)t>o where the controller 
is allowed to choose the drift fit and the volatility at from a set IC{x) C M x (0, oo) 
when Xt — x. Note that such a process is not necessarily Markovian. We are 
essentially interested in the problem of minimizing or maximizing the probability 
that the process hits a certain barrier 6 e M. If 6 = this can be interpreted as ruin. 
Problems like this often occur in continuous-time gambling problems or in actuarial 
or financial applications where one wants to avoid ruin. In [6] the authors, among 
others, consider in the setting of continuous-time gambling, the problem of reaching 
the target 1 with maximal probability. They show that maximizing the ratio -j^ 
at all time points solves the problem. The ratio often occurs in discrete-time 
gambling and serves as a measure of superfairness (see e.g. [I]). The proof of this 
result given in |6] follows standard techniques and consists of guessing the optimal 
control and then verifying that the associated value Q satisfies Q >V where V is 
the value function. This procedure involves a number of analytic results. 

We instead build on the following simple observation: When optimization criteria 
like hitting probabilities are considered, time transformations of the processes do 
not change such probabilities. Moreover for different processes which are admissible, 
it is possible to use different time changes. Finally constructing the time change 
in such a way that the diffusive part of the process is always the same, leads 
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to a favorable situation. Indeed we will show in Theorem |2.2| that the process 
which is obtained by maximizing the ratio at all time points (name this the 
extremal process) is under suitable time changes stochastically larger than any 
other admissible process. This is a very strong result and the proof we use here 
is very simple and based on the time change property of the Brownian motion. It 
is worth mentioning that in ^4 , part III also a time change is used to compare 
processes, however the time change is different and applied to a zero drift process. 
The main aim in 1^ is to construct extremal processes w.r.t. the increasing convex 
ordering by dominating one process by convex combination of other processes. For 
a recent paper on the stochastic comparison of Markov processes see . However 
note that our processes are not necessarily Markovian and allow a comparison only 
after a time change. 

In case the maximal ratio does not depend on x we can even strengthen our 
result to showing that the extremal process maximizes {Xt — aMt)t>o stochastically 
under suitable time changes where a € [0, 1] and Mt is the running maximum of 
the process. Thus the probability of a 'drawdown' is minimized by the extremal 
process. 

Our paper is organized as follows: In the next section we introduce the basic 
model, the time change and our two main results. In Section [3] we consider a 
few special cases and in Section [4] we consider some ruin problems. Part of them 
have already been solved by stochastic control methods but we show here that our 
approach is much simpler. 

2. The Model 

We consider a one-dimensional controlled diffusion process {Xt)t>o on a filtered 
probability space (ri,F, (Ff)t>o,P) with 

dXt ^ fitdt + (TtdWt, Xo=xeR (2.1) 

where iWt)t>o is an F-Brownian motion. We assume that the drift Ht and the 
volatility at can be chosen by a controller from a set JC{x) C K x (0, oo) when 
Xt — X. Thus, the set IC{x) gives all admissible pairs of drift and volatility when 
the process is in state a; € K. The drift (/it) and volatility {at) are supposed to be 
F-progressively measurable and satisfy 




for all t > 0. Let us denote by A{x) the set of all processes that can be constructed 
in this way with Xq = x. 

Suppose now {Xt)t>o G A{x) is an arbitrary process. Obviously Mt := a.^dWu 
is a continuous local martingale. The quadratic variation of {Mt)t>o is given by 

{M)t - / aldu. 
Jo 

Define T{t) := inf{M > | {M)u > t}. Then Mx(t) is equal to a Brownian motion 
(see e.g. [5], Theorem 3.4.6) which we denote again by {Wt)t>o for simplicity. We 
introduce the following time change: 

rT{t) rTit) 

Xrit) = X + Hudu + MT{t) ^ X + fiudu + Wt- 

Jo Jo 
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Changing the integration variable in the second term we obtain 



^iudu = / ^T(ii)T' {u)du. 



Since T{{M)t) = t we get: 



XTit)=x + I ^^du + Wf (2.3) 

"'0 ^T{u) 

We assume now further that there exist measurable functions to(-) and s(-) > 
such that 



mix) 

— sup 



{^:(/i,a)e/C(x)}, xeM, (2.4) 



s'^{x) Icr^ 
and we denote this special process by 

dX; = m{Xl)dt + s{Xl)dWt. (2.5) 



In what follows we will assume that (2.51 has a unique weak solution. This is for 
example guaranteed by 

1 + \m{y)\ 

dy < oo, for some £ > 



for all X € M. Recall that we already assumed that s > 0. 

In what follows we will show that {X^)tyQ has some extremal properties in the 
class A{x). To this end, consider the following definition: 

Definition 2.1. For two stochastic processes {Xt)t:^Q and {Yt)t>o we say that 
{Xt)t>o is stochastically smaller than {Yt)t>a (written (Xt) <st (Yt)) if 

Eh{Xt,,...,XtJ<Eh{Yt„...,YtJ 

for all < < ... < tn,n E N and measurable functions h : M" — > M which are 
increasing in all components and are such that the expectations exist. 

Recall that two real- valued random variables X and Y are ordered hy X <st 
Y when Eh{X) < Eh{Y) for all ft. : M — > M increasing where the expectations 
exist. The definition of {Xf) <st (Yt) given above is one of a number of equivalent 
statements: When we denote by C[0,oo) the set of continuous functions on [0, oo) 
and introduce the following partial ordering for f,g € C[0,cx)): 

f<c9 if/(i) <<?(i),Vt>0, 

Then (Xt) <st (Yt) is equivalent to 

for all h such that h : C[0, oo) — E, ft, is measurable, increasing w.r.t. <c and the 
expectations exist (see e.g. Theorem 4.1.1 in [I^). Now using Strassen's theorem 
(see e.g. [TT] Theorem 2. 8. A), we know that (Xt) <st (Yt) is also equivalent to 
the existence of a common probability space (fi, J^, P) and processes {Xt)t>o and 

{Yt)t>o on it such that {Xt)t>o = {Xt)t>o, {Yt)t>o = (l"t)t>o and X.{uj) <c Y.{uj) 
for all u! E il. 

We obtain the following result: 



4 



N. BAUERLE AND E. BAYRAKTAR 



Theorem 2.2. Suppose (X(*)(>o £ A{x) is defined as in (2.5) and (^f)t>o G A{x) 
is arbitrary. Assume further that the function rajs^ is locally Lipschitz and has 
linear growth. Then there exist continuous and strictly increasing time changes 
T, [/ : M+ ^ M+ such that 

(^T(t)) <st (^a(t))- 

Proof. We choose time change processes U and T such that U{J* s{X*)^du) — t 
and T(/g aldu) = t. Then 

X^ju, ^x+ I ^, } '[ du + W, 

and 



S i-^(7(„)j 



t 



'T{u) 

or when we use the definition Yj* := -'^^(j) and Yt :— Xrpi^f-j we obtain: 

Since mj is locaUy Lipschitz and has hnear growth, the SDE 

has a unique strong solution. Moreover, its law coincides with that of Y* . The 
advantage of working with Y is that, it is driven by the same Brownian motion W 
that drives Y . We will show that Y dominates Y path-wise, which will directly 
imply the statement of the theorem. Let 

TAT := inf{t > : max{|rt|, \Yt\} > N}. 

Since the difference F — F is of finite variation we have 




l^T{s) 


m{Ys)\ 




s^t)) 


m(y,) 


m(n) 







ds 



ds, 

which implies that Yt^r^ ^ Yt^T^ due to an application of Gronwall's lemma. Here, 
wc first use Jensen's inequlity, the second inequality comes from (2.4 1, and i^r is a 
Lipschitz constant. Now the result follows since t Atn = t ior large enough N. □ 



Corollary 2.3. Suppose {Xf )t>o G A{x) is defined as in (2.5) and {Xt)t>o & A{x) 
is arbitrary. Then under the assumptions of Theorem (2.2) we obtain: 

MXt <st infX*. 

t>o t>o 
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Proof. Since inff>o Xt = infs>o Xt(s) and goh({xt)t>o) = .9(inft>o Xt) is increasing 
w.r.t. <c for 5 : M — > M increasing, the statement follows from Theorem |2.2| and 
the discussion after Definition 12. 11 □ 



For the next result suppose that IC{x) = K, does not depend on x. Then 

m mix) „ ™ 
^ = forallxGM. 

Let us define Mj := supo<s<j Xs and M^ — supg<g<j X*. Then we obtain that the 
extremal process X* satisfies: 

Theorem 2.4. Suppose that JC{x) = JC for allx dM. and {Xl)t>o G A{x) is defined 
as in (2.5) and {Xt)t>o S A{x) is arbitrary. Moreover, assume that the initial state 
X is non-negative. Then it holds for a G [0, 1] 



where T, U : M+ — > M+ are the time changes from Theorem 2.2 



Proof. First note that (Xt) and (X^) can be constructed on a common probability 
space without changing their distribution such that the driving Brownian motion 
is the same (as in the proof of Theorem 2.2). Using this construction we obtain: 

Y* Y d f' fm m{XT(u)) \^ 

Arr„^ - XTIf\ = { ^ ^T^T r ]du. 



By our assumption > -^jj^ for all x G M hence X'^f^^^ > XT{t) P-a.s. for alH > 
and 

X^(,)-XT(t)t int P-a.s. 
Let i > be arbitrary and define r :— sup{s < t : X^^^^ — M^^^^}. It holds (note 
that MT{t) > since Xq > 0) 

XT(t) - OLMT(t) = XT(t) - Xt{t) + Xt(t) - 0:Mx(t) 

This inequality holds also true when we consider jointly different time points < 
ti < ±2 < . . . < tn and thus the statement follows. □ 

As an application we have that the extremal X* minimizes the probability of an 
a drawdown, which we define to be the event Xt < aMt for some t G M. 



Corollary 2.5. Under the assumptions of Theorem 2.4 we have that X* in (2.5) 
minimizes the probability 

P{Xt < aMt for some i G K), for X e A{x), 

for any a G (0, 1). 

The above criteria could be useful for fund managers who do offer this type of 
guarantee in order to satisfy the aversion to deception of the investors. (For relevant 
references and an alternative optimization problem in which the drawdown is taken 
to be a constraint, see [5].) 
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3. Some Special Problems 

3.1. Controlled Diffusions. A special case of the model in Section [2] is a con- 
trolled Ito-process given by 

Jo Jo 

where u — {ut)t>o is an F-adapted control process taking values in a set [/ C M™ 
and /I : M X [/ M and cr : M x J7 ^ M are continuous functions and satisfy the 
usual growth conditions which imply that the stochastic differential equation has a 
solution. Here the extremal process is obtained by 



3.2. Switching Problems. Another special case of the model presented in Section 
[2] are the so-called switching problems. Here we suppose that we have a set of 
possible regimes I = {1,...,to} and a switching control consists of a sequence 
{Tmin)neN where (t„) is an increasing sequence of F-stopping times and i„ are 
Ft-^ -measurable, I-valued random variables, representing a regime. Given such a 
sequence we define the control process 

It := X! *"l[r„,r„+i)(i), t > 0. 

n>0 

The controlled process is then given by 

dXt= fi{Xt,It)dt + c7iXt,It)dWt, t>0 
for suitable functions /ii(-) = and ai{-) ~ (7{-,i). Let 

:= <^ X e M : — - — - = max <^ — : j G X 

The extremal process is here obtained by choosing regime i G Z if and only if the 
process is currently in set i?;. 



4. Minimizing the Probability of Ruin 



In this section we consider some more specific applications of our previous find- 
ings. Corollary |2.3| in particular implies that the process X* minimizes the proba- 
bility Pa;(Xt < h for some time point i € K) = P(inff>o Xt < b) for arbitrary b eR 
whenever this is a reasonable and non-trivial problem. 

Theorem 4.1. The extremal process X* (which does not depend on b) minimizes 
the probability of ruin. The minimum probability of ruin is given by 



inf 

xeA{x) 



^^iniXt < b) 



p{oo)'' 



where p is the scale function of X* , i.e 
p{x) — I exp 



-du 



d^. 
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Proof. The proof that X* minimizes the probabihty of ruin foUows from Corollary 
2.3 and the fact that h{x) = 1 — l{x<b} is an increasing function. The expression 
for the minimum probability of ruin is then simply the probability that X* does 
not reach 6, which can be easily computed in terms of the scale function as in page 
344 of |5]. □ 

In particular if (Xj) is the surplus process of an insurance company and 6 = 
we are faced with a so-called problem of minimizing the ruin problem which we 
will analyze in the next sections. We observe the underlying optimality principle 
of seemingly different problems are the same and are given by the extremal process 
X* . In the stochastic control approach that was taken in the literature each case 
would have to be solved and then verified separately. 

4.1. Controlling Risk Processes by Proportional Reinsurance. In Section 
2.2.1 of 9J one can find a proportional reinsurance model where the surplus process 
is given by 

Xt=XQ+ [ {us9 - {0 - T]))ds + a f UsdWs 
Jo Jo 

and Ut € [0, 1] denotes the retention level at time t of a proportional reinsurance 

contract. In this case we have 

= u9 — {6 — rj), (j(u) — ua 

and U = [0, 1]. We assume that rj < 9. 

We divide the problem into two cases. First, we assume that u > e for small 
e > and apply Theorem |4.1[ With this restriction we know in order to minimize 
the probability of ruin we have to maximize the expression 

u9 — 9 + ri 



This gives us 



u e (e, 1] 



2(1- Al. 



When Ut < e, for some t, changing the control at that time to ut — {9 ~ r\)l9, 
one could build a process that path-wise dominates the original controlled process. 
Therefore, without loss of generality we can assume that u > e and, hence, the 
control Ut = u* minimizes the probability of ruin in this case. Compare with 
Lemma 2.4 in [iJ;, in which the problem has been solved by constructing the solution 
explicitly and then using a verification theorem. 

4.2. Controlling Risk Processes by XL Reinsurance. Alternatively one could 
try and find the excess-of-loss reinsurance which minimizes the probability of ruin. 
In such a reinsurance contract a limit m > is chosen such that the insurance 
company has to pay min{Z, u} when Z is a claim. In this case it is reasonable to 
define the surplus process by 

Xt = xo+ [ {9fi{us)-{9-ri)EZ)ds + a [ a{us)dWs 
Jo Jo 

and Ut > denotes the limit at time t of an excess-of-loss reinsurance contract and 
fi{u) :=Emin{Z, w}, o'^(m) := E min{Z, u}^. 
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Again we assume rj < 6. Proceeding like in the previous subsection we have to 
maximize 

e^i{u) - (6* - r/) E Z 

A2cr2(u) 



over u £ U = [Q, oo) (the case u = Q can be treated as in subsection 4.1 1. If Z is 
exponentially distributed with parameter A > then we have to maximize 

2 - e-^'"(2 + 2mA - u2A2(A - 1)) 

over u > 0. For 9 = = rj = \ the solution is given by u* = 2 + L(— 2e^^) 
where L[x) is the upper branch of Lambert's M^- function which is the inverse of 
f{x) = xe^ . To the best of our knowledge this problem has not been treated before. 

4.3. Controlling Risk Processes by Investment. The next problem which has 
been considered in [9 , Section 2.2.2 is the problem of optimal investment for an 
insurance company. Here the surplus process is given by 



dSt = Tjdt + asdWi 



and the insurer can invest into a risky asset given by 

dZt = mZtdt + aiZtdWl- 

The Brownian motions {W^)t>o and {Wl)t>o are supposed to be independent. 
Given the investment strategy {ut)t>o, where Mt G M is the amount invested in the 
risky asset at time t we arrive at the controlled surplus process 

dXt = {v + utm)dt + asdWf + ajUfdWl . 

This process is in distribution equal to the process 



dXt 



{f] + utm)dt + y/ (t| + aju^dWt 



with one Brownian motion (Wt). When we want to minimize the probability of 
ruin in this case we have to maximize 

rj + um 

c 

over all It e M. This yields 



acTr V V 

compare Theorem 2.7 in [3] 



+ m^ai — tjCTi 



4.4. Controlling Risk Processes by Reinsurance and Investment. In sec- 
tion 2.2.3 of [S] the combination of both investment and reinsurance is considered. 
The controlled process is here given by 



dXt = (btO -{e-ri) + mAt)dt + y cr|6? + ajA^^dWt 

with control ut = (6t, Aj) and assumption rj < 9 < rj + \/'rf' -\- m?a'g/a'^. In order 
to minimize the probability of ruin in this case we have to maximize 

h9-{9-i])+ TfiA 
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over ^ e M and b E [0, 1] which gives us 

compare Theorem 2.8 in [9]. The case b = A = Q can be treated as in subsection 

In [7j a shghtly different approach was taken. Inspired by the results of [6], the 
authors in first guess the optimal portfolio by minimizing the ratio ( |4.1[ ), use 
the form of the portfolio to construct the value function explicitly and then use a 
verification theorem to prove optimality. We, on the other hand, have directly (us- 
ing the stochastic ordering arguments) shown that the strategy in (4.2 1 is optimal. 
We also have shown the optimality of the extremal process X* for general diffusion 
processes and calculated the corresponding minimum probability of ruin. As an 
aside it also turns out that the same strategies minimizes the drawdown. 

4.5. Controlling Investment into a Financial Market. Let {Si,-- - ,S'„) be 
the adapted price processes of risky assets satisfying 

^ u — l 

with Si{0) — Si > 0. We will denote the covariance matrix by a := aa' which we 
will assume to be positive definite. 

Let (7rt)t>o = (7ri(t), • • • 7r„(i))t>o denote an adapted portfolio process where 
TTiit) gives the proportion of the wealth which is invested in asset i at time t, i.e., 
X^iLi '^ii^) — 1 t > 0. Then the wealth satisfies 

with X^(0) 1. Here, 

n n 

1=1 1=1 

Solution to this equation is 

iogx^(<)=. / j^s)ds + y] I <j:{s)dwAs) 

where 



E 

i/=i 



Let us denote a^"^ = X]l!=i('''?)^- Obviously for a > the probability 
V{X^ > a for aU t > 0) = P(logXf > log(a) for all t>0). 



Now, thanks to Theorem 4.1 when the drift and the volatility coefficients are con- 
stant then the portfolio that minimizes the probability of ruin is given by the 
maximizer of 

Er=l E"=l TTiaij-TTj 2' 

subject to the constraint that '^i ~ 1' instead of the maximizer of the so-called 

Sharpe ratio (the ratio of mean value of the portfolio to its standard deviation) in 
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the mean-variance portfolio analysis of Markowitz or the maximizer of the growth 
rate (which is the numerator of the above expression) which yields the log/growth 
optimal portfolio whose maximizer is given by the so-called Merton ratio. For 
further comparisons of optimizers of different optimality criteria, see Section 4 of 
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